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Abstract 

The generation of spikes by neurons is energetically a costly process. This paper 
studies the consumption of energy and the information entropy in the signalling 
activity of a model neuron both when it is supposed isolated and when it is coupled 
to another neuron by an electrical synapse. The neuron has been modelled by a four 
dimensional Hindmarsh-Rose type kinetic model for which an energy function has 
been deduced. For the isolated neuron values of energy consumption and informa- 
tion entropy at different signalling regimes have been computed. For two neurons 
coupled by a gap junction we have analyzed the roles of the membrane and synapse 
in the contribution of the energy that is required for their organized signalling. 
Computational results are provided for cases of identical and nonidentical neurons 
coupled by unidirectional and bidirectional gap junctions. One relevant result is that 
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there are values of the coupling strength at which the organized signalling of two 
neurons induced by the gap junction takes place at relatively low values of energy 
consumption and the ratio of mutual information to energy consumption is relatively 
high. Therefore, communicating at these coupling values could be energetically the 
most efficient option. 
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1 Introduction 



The relation between cerebral energy c onsumption and n euronal activity was 



first suggested by Roy and Sherrington ({Sherrington 



18901 ). A neuron transmits 



information by depolarizing and repolarizing its membrane to generate action 
potentials, what requires energy obtained from ATP produced from glucose 
in the mitochondria. The rate of ATP generation depends on multiple factors 
and if any of them causes the replenishment of ATP supplies not be enough to 
satisfy the demand from the neuron its refractory period will increase and the 
information will be altered. The generation of actions potentials, or spikes, is 



metabo 



( iLennie 



ically costly with energy demands tightly coupled to spiking frequency 



2003 



Smith et al. 



20021 ) what makes the metab olic energy required 



to maintain neural activity in a global scale very high ([Clarke fc L.Sokolofi 



19991 . 



Attwell & Laughlinll200ll . iLaughlin 



2001 



Sickcvitz 



20041 ). In humans, 
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for instance, the brain has onl y 2% of the body mass a nd consumes 20% of 



the human metabolic energy (jClarke k L.Sokolofi 



1999|) being a large frac- 



tion of this total energy expended in the generation of the firing sequences 
of action potentials that neurons use to represent and transmit information 



( lAttwell k Laughlin 



20011 ) . The demand of energy to generate these sequences 



of action potentials is so high that energy supply seems to be a real constraint 



for neural coding ( iLaughlin 



20011 ) and, it has been suggested that nature, 
searching a compromise between energy consumption and representational 
capacity, might have developed energy efficient codes, that is, c odes that maxi 



mize the ratio of representationa 



19961 . 



2002 



Schreiber et al. 



capacity to energy expended (ILevy k Baxter 



20021 ). For instance, in the early visual system en- 



ergy efficient coding could be a real biologicall y-based justification for sparse 



coding in the cortex and retinal ganglion cells ( jVincent et al. 



20051 ). 



This paper approaches the problem of whether biological computation op- 
timizes energy use in the way neurons communicate. The evaluation of the 
energy efficiency of the transmission requires both, calculation of the amount 
of information transmitted and calculation of the energy cost of the transmis- 
sion. Quantitative mathematical models have proved to be an indispensable 



tool in pursuing the goal of understanding neuron dynamics (IHerz et al. 



20061 ) 



of rea 



1984 



of models showing 


:he irregular spi 


ce bursting characteristic 


(Hodekin k Huxlev 


1952. 


FitzHugh 


1961. 


Hindmarsh k Rose 



Rose k Hindmarsh 



Monte et al. 



2003 



1985) has received much attention (Rulkov 



vanchenko et al 



2004. 



Venaille et al. 



2005 



2001 



Abarbanel et al. 



1996 .lHuerta et al.lll997l. 



Rosenb lum k P ikovsk vil2004 .11 Belvkh k Haslerll2 005 



Havashi &: Ishizuka 



E 70. 066107 20041 . 



1991 



L ago- Fernandez et al. 



Nagai et al 



2000 



Yoshioka 



200 



Hasegawa 



20051 ). As these models are kinetic models 
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with no energy considerations, it could be of interest to further develop them in 
such a way that they could be used to study the relation betw een the dynami- 



cal propert ies of a neuron and its energy implications. In Refs. ( iTorrealdea et al. 



2006 



1984 



200I 



2007 ) we deduced for a th ree dimensional Hindmarsh-Rose neuron (IHindmarsh fc Rose 



Rose fc Hindmarsh 



19851 ) a function of its variables and parameters that 
can be associated to the neuron as a real electrical energy. This energy func- 
tion was used to evaluate the energy consumption of the neuron during its 
signalling activity. Our procedure to find a physical energy compatible with 
the dynamics of a dynamical system described by differential equations can 
be used to associate energies to many of the generally used models of neu- 
rons. Simple models with polynomial derivatives such as FitzHugh-Nagumo 
or Hindmarsh-Rose models are particularly apposite to associate to them an 
electrical energy function. Most of these models have been inspired in the work 
of Hodkking and Huxley but they do not conserve the clear physical meaning 
of the original work making it difficult to associate to them a physical energy. 
It is precisely here where our method can help. In this paper we deduce an en- 
ergy function for a four dimensional Hindmarsh-Rose model. It is remarkable 
that this four dimensional energy turns out to be a natural extension of the 
one we found for the three dimensional case, what enhances the confidence in 
our result. 



Energy efficient information transmission from the point of view that inputs 
are optimall y encoded into Boltzmann d istributed output signals has been 



analyzed in ( iBalasubramanian et al. 



200ll ) . An open question is the determi- 



nation of the energy cost of generating the spike trains that codify each of the 
different output symbols. Our approach could provide a way to determine the 
energy cost of the generation of these spike trains. 
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Most of the cells in the nervous system are interneurons, that is, neurons that 
communicate only to other neurons and provide connection between sensory 
and motor neurons. Signals are transferred from one neuron to another through 
synaptic junctions which can be chemical or electrical. The rate of information 
transmitted between two neurons can be quantified calculating the mutual in- 
formation between the corresponding tra ins of spikes of the presynaptic and 



postsynaptic neurons ( jRieke et al. 



19991 ) . Electrical synapses are considered 



to be frequent and, it is believed, that they provide a fle xible mechanism 



for modifying the behavi or of an oscillatory neural network (IConnors fc Long 



2004 



Kepler et al. 



19901 ). Most of the electrical synapses are formed by gap 



junctions between neurons of the same ty pe, homologous gap 



unctions. Het- 



200lh . In this 



erologous gap junctions are less frequent ( IGalarreta &: Hestrinl 
paper we analyze model neurons of the same type and we refer to two neu- 
rons as identical when they share the same set of parameter values and as 



nonidentical when they differ in the value of some parameter. 



A neuron responds to income signals from other neurons with changes in its 
firing regime that modify its information capacity as well as its average en- 
ergy consumption. A natural way to propagate information through a channel 
of neurons could be via partial or total synchronization of the postsynaptic 
neuron to the signalling pattern it receives from its presynaptic neighbor. For 
instance, electrical synapses between All amacrine cells and ON-cone bipo- 
l ar cells are considered ess ential for the flow of visual signals in the retina 



( IKolb fc Flamiglietti 



19741 ) and temporally precise synchronization between 



them of subthresho 



( iVeruki &: Hartveit 



d mem brane potential fluctuations has been demonstrated 



2002a ). The degree of synchronization reached by the neu- 



rons conditions their capacity to transmit information and the energy con- 
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sumption of their signalling activity. As the degree of synchronization is highly 
dependent on the coupling some coupling conditions may be more favorable 
than others for an energetically efficient transmission of signals. In this work 
we investigate how this efficiency depends on the type of coupling, unidirec- 
tional and bidirectional, and on the values of the coupling strength when both 
neurons are coupled electrically. We also investigate the role of the electrical 
junction in the provision of the energy that the neurons require to maintain 
their synchronized regime. 

In Sec. 2 we summarize a procedure to find an energy function that quan- 
tifies the physical energy associated to the states of a generic model neuron 
described by differential equations. This function can be used to quantify the 
consumption of energy of the neuron in its different possible signalling regimes. 
We also discuss the balance of energy when two generic neurons are coupled 
electrically and quantify the contribution of the synapse to the total energy 
required for both neurons to maintain the synchronized signalling activity. 
This discussion is particularized to the case of a four dimensional Hindmarsh- 
Rose model of thalamic neurons for which analytical expressions of energy 
consumption and synapse contribution are given. In Sec. 3 we present some 
considerations relative to the way we have computed the information entropy 
and the mutual information of two electrically coupled neurons. In Sec. 4 we 
present computational results. Firstly, results are given for the information 
entropy rate and energy consumption of the different patterns of spike trains 
that are generated by an isolated neuron at different values of the applied ex- 
ternal current. Secondly, results are given for two neurons coupled electrically. 
Four cases have been studied. Identical and nonidentical neurons coupled with 
unidirectional coupling and with bidirectional symmetrical coupling. For each 
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studied case results of mutual information rates, energy consumption, ratios of 
mutual information to energy consumption, and relative weight of the synapse 
contribution of energy are presented and discussed. Finally in Sec. 4 we give 
a brief summary and present our conclusions. 



2 Energy considerations 



In this section we quantify the energy required by a model neuron to maintain 
its signalling activity. We analyze the energy requirements when the neuron 
acts as an isolated oscillator and also the energy aspects linked to the synap- 
tic junction when two neurons are electrically coupled. In order to quantify 
theoretically the energy consumption of a model neuron we require an analyt- 
ical e xpression of the ene rgy of the neuron in its different possible states. In 



Ref. ( ISarasola et al. 



20041 ) we described how to associate to a chaotic system 
a function of its dynamical variables that can be formally considered a real 
physical energy of the system. By real physical energy we mean that if a set 
of kinetic equations is considered a good model for the dynamical behavior of, 
for instance, a thalamic neuron, then we must consistently consider the energy 
associated to it a good model for the energy implications of that dynamical 
behavior. We have tested the procedure with ma ny electrical and mec hanical 



systems always obtaining the correct energy. In (ISarasola et al 



20041 ) an ex- 



ample is given for an oscillatory electric circuit. In the 



very quickly summarize the procedure described in Ref. (ISarasola et al. 



following section we 



2004J) 



which can be used to find an energy function for a model neuron. 
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2.1 Energy function associated to a model neuron 



Let us consider an oscillatory autonomous dynamical system represented by 
x = f(x), where x G 3?" and f : 9ft n — > 9ft n is a smooth function, as the 
mathematical model of a generic neuron. The velocity vector field f(x) can 
be expressed as sum of two vector fields f(x) = f c (x) + fd(x), one of them, 
f c (x), conservative contain ing the full ro tation and the other, fd(x), dissipative 



containing the divergence (Donal 
the equation 



19861 ). Taking the conservative vector field, 



0. 



where VH T denotes the transpose gradient of function H, defines a partial dif- 
ferential equation from which a function H(x) can be evaluated. This function 
H(x.) is a generalized Hamiltonian for the conservative part x = f c (x) as long 
as it can be rewritten in the form x = J(x.)VH where J is a skew symmetri c 



matrix that satisfy Jacobi's closure condition (jOlver 



1993 



Morrison 



19981 ) 



If that is the case, we consider H(x) as an energy associated to the original 
system x = f(x). This energy is dissipated, passively or actively, due to the 
dissipative component of the velocity vector field according to the equation, 

H = VH T f d (x). (2) 



In Ref. (ITorrealdea et al 



120061 ) we used this procedure to find an energy func- 
tion for the well-known three variable Hinmarsh-Rose thalamic model of a 
neuron. In the last part of this section we apply the same procedure to find 
and energy function for the four dimensional versio n of the model that was 



introduced by Pinto et al. in Ref. (IPinto et al. 



20001 ) . This energy function is 



used to evaluate the energy consumption of the neuron in isolation and also 
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Fig. 1. Projection on the x,y,z axes of the attractor of a postsynaptic four dimen- 
sional Hindmarsh-Rose neuron forced by an electrical unidirectional synapse, Eqs. 
15, to follow another identical neuron. Values of the coupling strength (a) k = 0, 
(b) k = 0.25, (c) k = 0.7, (d) k = 1. 

when it is connected to other neurons through electrical synapses. It provides 
the basis for all the computational results presented in this work. 

2.2 Electrically coupled neurons. Energy contribution from the synapse 

In this section we analyze the balance of energy required to maintain the 
signalling activity of two model neurons coupled by an electrical synapse. 
Let us consider the oscillating neurons &i = fi(xi) and x 2 = f2(x 2 ) coupled 
electrically according to the scheme, 

xi = fi(xi) + Ki(x 2 - xi) 

(3) 

x 2 = f 2 (x 2 ) + K 2 (xi - x 2 ), 
where fi,f 2 : 9ft n — > 9ft n are smooth functions, K 1; K 2 G x 3fJ n are di- 
agonal matrices representing the coupling strength with entries k\, fc 2 > 
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% = 1, ...n, and xi, x 2 G 3ft n indicate the state of the coupled neurons. Note 
that the terms Ki(x 2 — Xi) and K 2 (xi — x 2 ) represent the gap junction that 
connects both neurons. These two terms, taken together, represent a poten- 
tially bidirectional electrical junction with selective ion channels of different 
conductances depending on the coupling matrices K x and K 2 . 

The signalling activity of a neuron consists of the generation of action poten- 
tials with different patterns of repetitive firing or bursting. This oscillatory 
behavior, when represented in the phase space, makes the temporal evolution 
of the neuron remain confined to an attractive region which is characteris- 
tic of its dynamics. When two neurons are coupled their respective dynamics 
change although still remaining confined to attractive regions in the phase 
space, see Fig. 1 for the particular case analyzed in Section 2.3.2 of the pa- 
per. The nature of the coupled oscillatory regime of each neuron depends on 
the particular values of the coupling matrices K x and K 2 . As the temporal 
trajectory xi(i) remains confined to an attractive region of the phase space, 
the long term net average energy variation along that trajectory of the system 
xi = fi(xi) + Ki(x 2 — xi), neuron and synapse, is zero. That is, 

(Vif £ f^xO) + (VHl Kx(x 2 - Xl )> = 0, (4) 

where the brackets represent averaging on the attractor and Vi?^ denotes the 
transpose gradient of the energy function of the neuron X4 = fi(xx). The same 
argument applies to system x 2 = f 2 (x 2 ) + K 2 (xi — x 2 ). 

The first term of Eq. (4) can be associated with the variation of the energy of 
the first neuron through its membrane and the second term with the variation 
of its energy through the synapse. Thus, for each of the coupled neurons, 
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i = 1,2, the following balance of energy applies on average, 

(HY m + (H)i = 0, (5) 

where (H) l m and (H)\ stands for the average energy variation of neuron i 
through its membrane and synapse respectively. 

According to Eq. (4), if Ki = 0, the average energy variation of the energy 
of neuron one through its membrane is zero, (H)^ = 0. The same applies 
to neuron two if K 2 = 0. In other words, if a neuron does not receive signals 
from any other neuron the energy it obtains through the membrane, {H + Y m , is 
perfectly balanced by its dissipation of energy through the membrane, (H~) % m . 
Nevertheless, according to Eq. (5), if a neuron is signalling forced by signals 
arriving from another neuron through a gap junction, it is the global average, 
membrane plus synapse, what is zero. The average variation of energy through 
the membrane is no longer zero. Therefore, when two neurons are coupled a 
contribution of energy from the synapse is required to maintain their coop- 
erative behavior. This fact is a consequence of the forced oscillatory regime 
induced by the synapse and it is to be expected that the relative weight of the 
contribution of energy from the synapse to the energy balance of the coupled 
neuron be dependent on the strength of the synapse itself. 

For each of the neurons, % — 1, 2, Eq. [5] can be rewritten as, 

(H + y m = -(H~y m -(Hy s , (6) 

where {H + ) % m stands for the average of the positive part of the energy deriva- 
tive, i.e., the energy income rate through the membrane, and (H~)' l m for the 
average of the negative part of the energy derivative, i.e., the energy dissipa- 
tion rate through the membrane. Equation [6] emphasizes the fact that the 
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total average income of energy through the membrane of the neuron equals 
its dissipation trough the membrane plus a net flow of energy in the synapse. 
From Eq. [6] the relative weight, Sw, of the contribution of the synapse to the 
total energy income would be, 

Sw = (7) 

This expression will be used later on in the paper to quantify the relative 
contribution of the synapse in the different coupling conditions studied in this 
work. 



For the particular case of identical neurons and bidirectional gap junctions 
fx = f 2 = f and K x = K 2 = K, the total average energy variation of neurons 
one and two in the synapse is, 

(H) s = (H)l + {H)l (8) 

where 

(ij): = (V// / (x i ) T K(x j -x i )), (9) 

with i,j = 1,2; % ^ j. Equations (9) are symmetrical with respect to an 
exchange of variables x, and x^ and as both neurons are identical and undis- 
tinguishable (H)] and {H)\ must be equal and, therefore, the total energy 
variation in the synapse is 2 (ViljK(xj — Xj)). On the other hand, as both 
neurons are identical and the gap junction bidirectional and symmetrical, they 
are energetically identical with relation to the synapse and, on average, there 
cannot be any net flow of energy from one neuron to the other through the 
synapse. As the net average energy variation at the synapse site is not zero 
the gap junction itself must act as a source or sink of energy for both neurons. 
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Note that the degree of synchronization reached, measured in terms of the 
norm of the error vector e = ||xj — Xj|| , will condition the magnitude of this 
contribution of energy. If the two neurons are identical, and the strength of 
the coupling large enough, the synchronization error goes to zero and, there- 
fore, signalling transmission between identical neurons in complete synchrony 
occurs with no energy contribution on average from the synaptic junction. 



2.3 The four dimensional Hindmarsh-Rose neuron 



The Hindmarsh-Rose mo del of a thalamic neuron (IHindmarsh fc Rose 



1984 



Rose fc Hindmarsh 



19851 ) is a qualitative three dimensional model which is 
widely used in the study of neuron dynamics because it can produce several 
modes of spiking-bursting activity, including a regime of chaos, that appear 
similar to those seen in biological neurons. The model, alt hough qualitative, is 



not un realistic. Rose and Hindmarsh in a series of papers (IRose &: Hindmarsh 



1989a 



cj) showed how a Hodking-Huxley like model, based on ionic currents 
that can be related to experimental recordings, is derived from it. However its 
parameter space for ch aotic behavior is much more restricted th an what is ob- 



served in real neurons ( jSelverston et al. 



2000 



Pinto et al. 



20001 ). The chaotic 



behavior is greatly expanded by incorporation of a fourth slow variable that 
increases the realism of the description of slow Calcium currents. This four di- 
mensional model produces simulations of i ntracellular activity which are even 



more similar to the biological observations (jSelverston et al. 



2000. 



Pinto et al. 



20001 ) . In this paper we represent a single neuron by the four dimensional 



extension of the original Hindmarsh-Rose model which is described by the 
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following equations of movement: 



x = ay + bx 2 — cx 3 — dz + £1 



y = e — fx 2 — y — gw, 



z = m(— z + s(x + h)), 



w = n(— kw + r(y + 1)). 



(10) 



In the model variable a; is a voltage associated to the membrane potential, vari- 
able y although in principle associated to a recovery current of fast ions has 
been transformed into a voltage, and variable z is a slow adaptation current as- 
sociated to slow ions. These three first equations constitute the standard three 
dimensional model. Variable w represents an even slower process than variable 
z and was introduced because a slow process such as the calcium exchange 
between intracellular stores and the cytoplasm was found to be required to 
fully reproduce the observed chaotic oscillations of isolated neurons from the 
stomatogastric ga nglion of the California spiny lobster Panulirus interruptus 



( jPinto et al. 



20001 ) . Parameter I is a external current input. The time variable 
of the model is dimensionless. For the numerical results of this work we fix the 
parameters to the values a = 1, b = 3.0 (mV)" 1 , c = 1 (mV)~ 2 , d = 0.99 MQ, 
£ = 1MO, e = 1.01 mV, f = 5.0128 (mV) -1 , g = 0.0278 Mfl, m = 0.00215, 
s = 3.966 /xS, h = 1.605 mV, n = 0.0009, k = 0.9573, r = 3.0 //S, 1 = 1.619 mV. 



These numerical va 



in Ref. ( Pinto et al. 



ues refer to cm 2 and are the same that have been used 



20001 ) . Both the three dimensional and four dimensional 



models have regions of chaotic behavior, but the four dim ensional model ha s 



much larger regions in parameter space where chaos occurs ( jPinto et al. 



2000|) 
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2.3.1 Energy consumption when signalling in isolation 

In the Hindmarsh-Rose model given by Eq. (10) the vector field f(x) can be 
expressed as sum of the following vector fields, 



f c (x) 



/ \ 

ay — dz 

—fx 2 — gw 
msx 
nry 



and f d (x) 



/ \ 

bx 2 - cx 3 + £1 

e - y 
msh — mz 



nrl — nkw 



(11) 



V "* / 

As it can be observed f c (x) is a divergence free vector that accounts for the 
whole rotor of the vector field f(x), and f<f(x) is a gradient vector that carries 
its whole divergence. Consequently, the energy function H(x, y, z, w) will obey 
the following partial differential equation, 

, s& H ,r 2 dH dH 

(ay ~dz)—- (fx + msx— + nry— = 0, (12) 

which has the cubic polynomial solution 



H(x,y,z,w) 



V 



l> (2 jy , lllMl ■ gill' ; , 



a \3 
d 



or + ay" + 



a \ ams 



(msd — gnr)2; — 2dyz + 2gxw 



(13) 



where p is a parameter. As in the model time is dimensionless and every adding 
term in Eq. (13) has dimensions of square voltage, function H is dimensionally 
consistent with a physical energy as long as parameter p has dimensions of 
conductance. In this paper we fix parameter p to the arbitrary value p = 
— IS. The minus sign has been chosen to make consistent the outcome of the 
model with the usual assumption of a demand of energy associated with the 
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repolarization period of the membrane potential and also with its refractory 
period (see Fig. 2). 



Note that if parameter g is set to zero the four dimensional system given by 
Eqs. (10) reduces itself to the standard three dimensional model, as variable 
w becomes uncoupled, and Eq. (13) reduces to, 



H(x, y,z) = - (- fx 3 + ^^x 2 + ay 2 + —z 2 - 2 dyz 
a V 3 a a > 



which is the exp ression for the energy o f a three dimensional model that we 



reported in Ref. (ITorrealdea et al. 



20061 ). 



It can be easily checked that the energy derivative H = VH T f d (x.), that is, 



H 



2p 

a 



r 2 , msd-gnr . 
tx H s- 2 — x + gw 



ay — dz 



ams( msd ~ S nr ) z _ d y 



V 



gx 



/ 



\ 



bx 2 — cx 3 + ^1 



e-y 



msh — mz 



V 



nrl — nkw 



(14) 
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is also dimensionally consistent with a dissipation of energy. As the states of 
an isolated Hindmarsh-Rose neuron are confined to an attractive manifold the 
range of possible values of its energy is recurrent and the long term average of 
its energy derivative is zero. However, it has to be considered that the average 
involves a global balance of energy. The model itself incorporates, in a non 
explicit way, components which are responsible of the energy consumption to- 
gether with others which are the energy suppliers. 
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Fig. 2. (a) Action potentials and (b) energy derivative for the Hindmarsh-Rose model 
neuron, (c) Detail of the energy derivative associated to two spikes showing the 
dissipation of energy during the depolarization of the membrane potential (negative 
area) and its ulterior demand of energy during its repolarization period (positive 



area . 



Figure 2(a) shows a series of action potentials (variable x in the model neuron) 
and Fig. 2(b) shows the energy derivative H corresponding to that series. In 
Fig. 2(c) a detail of the energy derivative corresponding to a train of two 
action potentials is also shown. For each action potential it can be appreciated 
that the energy derivative is first negative, dissipation of energy while the 
membrane potential depolarizes during the rising period of the spike, and then 
positive, contribution of energy to repolarize the membrane potential during 
its descending period. During the refractory period between the two spikes 
the energy derivative remains slightly positive, still demanding energy, until 
the onset of the following action potential. To link the demand of energy to 
the repolarizing process is in agreement with the results about the energetics 



of ne ural activity in rat brain by Attwell and Laughlin (lAttwell fc Laughlin 



20011 ) who found that, for spiking frequencies of 4 Hz, 15% of the energy is 



used to maintain resting membrane potentials in non firing epochs while the 
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remaining 85% is used to restabilize membrane potentials in firing epochs. We 
calculate the average energy consumption per unit time of the neuron, that 
is, the metabolic energy that has to be supplied to the neuron to maintain its 
activity, evaluating the long term average of the negative component of the 
energy derivative, that is the energy that is dissipated in the process of spike 
generation. 

2.3.2 Two electrically coupled neurons 

Let us consider two Hindmarsh-Rose neurons electrically coupled according to 
the following equations, 

Xi — — ci y<i ~\~ b x ^ c x ^ d Zi ~\~ ~\~ i^x j x^ ) , 
Vi = e- ix\ -m- gWi, 

(15) 

^ = m(-Zi + sfa + h)), 
Wi = n(-kwi + r(yi + 1)), 

where k% > is the coupling strength and i,j — 1, 2 ; i ^ j are the indices 
for the neurons. Note that the coupling affects only to their respective first 



variables x\ anc 
often reported ( 


x-?.. This k 


ind of coupling between neurons has been verv 


Pinto c 


t al. 


2000. Abarbanel et al. 1996. Huerta et al. 1997. 


Rosenblum & Pikovskv 


2004 


, I. Belvkh & Hasler 2005. Hansel & Sompolinskv 


1992. Dhamala et al. 2004). 



Considering the energy of a neuron given by Eq. (13) and also Eqs. (4) and 
(5) we have for the average energy variation through the membrane of neuron 
of index i, 
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(H)l 



2p 



( 2 , msd-gnr . 



ams 



V 



ayi-dzi 



(msd-gnr) z % - dyi 



J 



b xf - c scf + £ ij 



e — 3/* 



msh 



V 



nrl — nk w; 



(16) 



/ 



where i, j — 1, 2 ; i =^ j. As it has been said, the energy consumption of neuron 
z corresponds to the average of the negative component of this derivative. 

The average energy variation at the synapse site of neuron i is given by, 



(17) 



These equations are used in what follows in the different circumstances in 



which the computation of energy is required. 



3 Information considerations 



A neuron responds to changes in the applied external current and to inputs 
from other neurons with changes in its firing regime that modify its informa- 
tion capacit y as well as its average en ergy consumption. Shannon's informa- 



tion theory fjShannon fc Weaver 



19491 ) provides a framework to quantify the 



amount of information that neurons can convey during its signaling activity. 
The first application of Shannons theory to estimate t he information entropy 



of sp ike trains was due to MacKay and McCulloch (IMackay fc McCulloch 



1952[). A comprehensive approach to understanding the information content 



of neural spikes, together with a review of some important contributions to 
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this area of research can be found in Ref. (IRieke et al.l 119991 ) . 



The information entropy S of a discrete distribution of probability pi is defined 
by S = —J2iPil°92Pi- This entropy is usually contemplated as a measure 
of the average uncertainty of occurrence of events that have a probability 
of occurrence pi. Although the information entropy of a discrete probability 
distribution is well defined, the situation is less clear when what is sought is 
the information entropy of a train of spikes emitted by a neuron. A long spike 
train emitted by a neuron can be observed as a succession of windows of spike 
trains of T ms length which are partitioned into bins of At ms length each. 
The presence or absence of a spike inside one of these bins can be codified 
as 1 or respectively, so that each window of spikes can be contemplated 

T 

as a particular symbol from a binary alphabet of 2 At different symbols. We 
suppose At small enough as to count no more than one spike per bin. 

Let us suppose that two interneurons are coupled by an electrical synapse 
according to Eq. (15). Let T\ and T\ represent symbols of the grammar of 
the different possible symbols that can be coded with the spike trains of the 
presynaptic and postsynaptic neurons respectively. The information entropy 
rate Sj of neuron j = 1,2 will be, 

S 3 = -Y,p(T;)Io 9 2P(T;). (18) 

i 

The mutual information, J m , between the spike trains of both neurons can be 
defined as 

/ m = -£p(T 2 >s 2 p(T*) 

i 

+ EP( T /) Y.v{T l 2in)lo92p{T 2 lT{\ (19) 

j i 

that is, the entropy of the postsynaptic train minus the average of its condi- 
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tioned entropies. This formulation emphasizes the fact that the mutual infor- 
mation between the two trains of spikes can be contemplated as the reduction 
in entropy that would take place in the postsynaptic train if the presynaptic 
one was known. 



According to ( iNemenman et al.ll2004j ) , since the maximum likelihood estimate 
of the probabilities p(Tj) is given by the frequencies, Eq. 18 provides an esti- 
mate of maximum likelihood of the real entropy. This estimator is biased and 
underestimates the entropy. With good sampling, N ^> K with K possible 
neuron responses and N number of samples, the estimate deviates from the 
correct value in an additive error (K — 1)/2N plus a term proportional to 
l/N. 

It has to be noted that the mean firing rate of a train of spikes conditions the 
probabilities of occurrence of the different symbols of the alphabet making 
their distribution not uniform on the set of bins. This fact reduces the vari- 
ability of the signal and the actual value of entropy do not reach its maximum 
possible limit of T/Ar bits per window. The maximum entropy rate that can 
be measure d with time precis ion At from a spike train of mean firing rate f 



is given by (IRieke et al. 



1999( 1. 



_ -rArlog 2 (rAr) - (1 - rAr) log 2 (1 - rAr) 

^max A 

At 

That is, the firing rate imposes a limit to the maximum entropy rate of a 
given signal. At a given mean firing rate the maximum entropy is reached 
when the presence or absence of spikes in a time bin Ar is independent of 
all other time bins, that is, when there are no temporal correlations in the 
timing of the spikes. If in addition to the absence of temporal correlations the 
spike train is perfectly reproducible across repetition of the same stimulus, 
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that is, if there is no noise, this maximum entropy rate sets an upper limit 
on the information that can be transmitted at the observed spike rate which 
is termed coding capacity. The actual information transmitted by the spike 
train compared with its coding capacity provides a measure of the efficiency 
of the coding. 



19981 ) of the 



In this work we have performed a naive estimate (jStrong et al. 
information entropy, generating successive windows of spikes of 25 ms length 
which are partitioned into 5 bins of 5 ms length each. The presence or absence 
of a spike inside one of these bins is codified as 1 or respectively, so that 
each window of spikes represents a symbol from a binary alphabet of K = 32 
different symbols. To estimate entropies in coupled neurons we have generated 
N = 10000 samples. According to Eq. 20 the maximum entropy rate that we 
could measure is S = 5 bits per average 25 ms window in case we had a 
long spike train firing at 100 Hz mean rate and with no time correlations. In 
practice, for the cases of coupled neurons we have studied, the active leading 
neuron is activated with an external current / = 3.024 what makes the neuron 
fire at a mean firing rate f = 39 Hz. At this firing rate, according to Eq. 20, 
the corresponding maximum entropy is S max = 3.65. Using Eq. 18, we have 
estimated S = 3.15 with an additive error (K — 1)/2N = 0.007. Thus, for the 
studied cases, windows of spike trains of T = 25 ms partitioned into bins of 
At = 5 ms provide enough variability for the observed neuron responses as to 
obtain, with no significant error, an information entropy near to its maximum 
value. 

Extrapolation of the windows to larger word length only imply very small 
corrections that have no incidence in our conclusions. On the other hand, the 
value of the information entropy rate that is obtained when calculating the 
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entropy of a given spike train is very dependent on the size of the time bin 
Ar used for its calculation. The entropy increases as Ar decreases illustrat- 
ing the increasing ca pacity of the train to convey information by making use 



of the spike timing (IRieke et al. 



1999). The value Ar = 5 ms used in this 



work corresponds to timing each spike to within 20 % percent of the typical 
interspike interval of the leading neuron which fires at a mean rate f = 39 
Hz. This value of time resolution and the window length used in this work are 
frequently used with empirical a nd simulated data . They are computationally 



appropriate and ar e used in Ref . 



cells. Also in Ref. (jStrong et al 



Koch et al. 



20041 ) to explore retinal ganglion 



19981 ) similar values are used to analyze re- 



sponses of a motion sensitive neuron in the fly visual system. For our purpose 
changing the time resolution Ar supposes a scale change in the calculated 
amount of information transmitted between two coupled neurons at different 
values of their coupling gain and therefore has no effect on the form of the 
curves ratio of information to energy. 



4 Computational results 

In this section we present results firstly for the neuron considered as an isolated 
oscillator and secondly for two neurons coupled electrically. For the isolated 
neuron results of energy consumption and information entropy at different 
values of the applied external current I are analyzed. For neurons coupled 
electrically, unidirectional and bidirectional couplings have been studied for 
identical and nonidentical neurons and results relative to mutual information, 
energy consumption, information to energy ratio and synapse contribution of 
energy are given. 
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Fig. 3. Information entropy per 25 ms spike train of an isolated neuron at different 
values of the external applied current /. Computation has been performed generat- 
ing 2000 spike trains of 25 ms at each value of the external current /. In the insets 
bursting regimes corresponding to / = 1.5 nA and / = 3nA. 
4-1 Information entropy and energy consumption in the isolated neuron 



To study the relationship between information entropy and energy consump- 
tion in the different possible oscillatory regimes of an isolated neuron we have 
computed its information entropy and average energy consumption at differ- 
ent values of the applied current /. To quantify the information capacity of 
the neuron in its different signalling regimes we have used Eq. (18). The com- 
putation has been performed generating 2000 different spike trains of 25 ms 
length at every value of the external current. As it can be seen in Fig. 3, 
the information entropy increases in plateaus corresponding to progressively 
richer signalling activity. This is so because the bursting regime of the isolated 
neuron is very sensitive to its applied external current I. Increasing / gives rise 
to subsequent bu r sting regimes of an increasin g number of spikes per burst 



( jPinto et al. 



2000 



Hansel fc Sompolinsky 



19921 ). The two insets to Fig. 3 show 



two examples of bursting regimes corresponding to I = 1.5 nA and / = 3nA. 



24 



Average energy consumption has been computed averaging over sufficiently 
large periods of time the negative part of the energy derivative given by Eq. 
(14). Results for consumption are displayed as positive, i.e. we define con- 
sumption as the absolute value of the energy dissipated. Figure 4 shows the 
results. The energy consumption of the neuron increases in steps with /, being 
very sensitive to the different firing regimes. The different plateaus correspond 
to the subsequent bursting regimes of increasing number of spikes per burst. 
Figure 4 also shows, in dots, the average number of spikes that the isolated 
neuron emits per unit length at different values of the applied current I. As it 
can be appreciated the energy consumption is more or less proportional to the 
average number of spikes per unit time. In the range of values of I between 
2.5 nA and 3nA the linearity is remarkable. A linear relation between energy 
consumption and frequency of spikes is what should be expected as energy con- 
sumption is basically linked to the generation of action potentials. This linear 



relation has been sometimes hypothesized in t heoretica 



ficiency in the signal transmission by neurons (jLaughlin 



1996 



stud i es of energy ef- 



2001 



Levy &: Baxter 



20021 ). Our results show that this simple law does not apply exactly to 
every signalling regime in the isolated neuron and, as we show later on, it is 
not going to be followed when two neurons are coupled. 



4-2 Two electrically coupled neurons 

In this section we consider two neurons coupled electrically. We suppose that 
the presynaptic neuron always signals in a chaotic regime corresponding to 
a external current 1% = 3.024. As we have seen, in this chaotic regime the 
neuron signals at its maximum information capacity. In the identical cases 
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Applied current I 

Fig. 4. Energy consumption rate, left vertical axis, and average number of spikes 
per train, right axis, of an isolated neuron at different values of the external applied 
current /. Computation has been performed generating 2000 spike trains of 25 ms 
at each value of the external current /. In the inset temporal energy derivative 
corresponding to / = 3 nA. 

the receiving neuron also signals at / = 3.024. For the nonidentical cases we 
have set the postsynaptic neuron close to its quiescent state at a low value, 
l 2 = 0.85, of its external current. We have analyzed the unidirectional case 
setting the gain parameters between both neurons as k\ = 0, k 2 = k and the 
bidirectional case setting k\ = k 2 = k. Computation has been performed, in 
every case, generating 10000 different spike trains of 25 ms length at every 
value of the gain parameter k. 

4-2.1 Mutual information 

Using Eq. (19) and the coding explained before, we have computed the mutual 
information between the trains of spikes of the pre and postsynaptic neurons 
at different values of the coupling strengths k\ and k 2 . The mutual infor- 
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mation between both neurons as well as the information entropy rate of the 
presynaptic and postsynaptic spike trains are shown in Fig. 5. 

When the two neurons are identical, sufficiently large values of the coupling 
strength lead both neurons to complete synchronization and, therefore, to a 
noiseless channel where no loss of information takes place. For two identical 
neurons with unidirectional coupling results are displayed in Fig. 5(a). At 
k = 1 the two neurons are completely synchronized and their mutual infor- 
mation reaches its maximum value that corresponds to the noiseless channel. 
The constant value of the entropy of the sending neuron serves as reference. 
The highest value measured for the entropy rate of the receiving neuron is 
0.18 bits per second that corresponds to an entropy of 4.5 bits per average 
25 ms train which is very near to the maximum possible entropy value, 5 bits 
per 25 ms train, that our procedure can detect. Figure 5(b) shows the mutual 
information rate between two identical neurons bidirectionally coupled and 
the information entropy rate of the sending and receiving neurons at differ- 
ent values of the coupling gain k. Due to the symmetry of the coupling the 
information entropy of both neurons is identical. At k — 0.5 the two neurons 
are completely synchronized and the mutual information reaches its maximum 
value that corresponds to the noiseless channel. 

In practice actual channels are always noisy and neurons nonidentical and it 
is of practical interest to know about the efficiency of the signal transmission 
in these circumstances. For nonidentical neurons with unidirectional coupling 
results are shown in Figure 5(c). As it can be appreciated, the information 
entropy of the receiving neuron increases rapidly with k reflecting the fact 
that the signalling activity of the postsynaptic neuron becomes more complex 
due to the coupling. Eventually, at larger values of k, the information entropy 
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Fig. 5. Mutual information, Im, and information entropies of the sending, s, and 
receiving, r, neurons at different values of the coupling strength k. (a) Identical 
neurons and unidirectional coupling, (b) Identical neurons and bidirectional cou- 
pling. (c)Nonidentical neurons and unidirectional coupling, (d) Different neurons 
and bidirectional coupling. 



of the receiving neuron equals the entropy of the sender in spite of the fact 
that both neuron are nonequal and complete synchrony does not take place. 
The mutual information also starts a slower and progressive increase from be- 
ing zero when both neurons work independently, at k = 0, to its maximum 
value slightly larger than 0.1 bits/ms which is reached at about k = 0.7. As the 
channel is noisy the mutual information never reaches the information entropy 
of the presynaptic signal. Finally, Fig. 5(d) shows the mutual information rate 
and the entropy rates of two nonidentical neurons coupled bidirectionally. The 
dynamics of the neurons is now more complex. The information entropy of the 
receiving neuron soon reaches a relatively high value and progressively dimin- 
ishes with subsequent increment of the coupling strength k. The information 
entropy of the sender also experiences a slight decline as both neurons mu- 
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tually synchronize. The channel is noisier than in the unidirectional case and 
the values reached by the mutual information are now lower and more erratic. 

4-2.2 Average energy consumption 

We have calculated the average energy consumption per unit time that is re- 
quired to maintain the organized bursting of two electrically coupled neurons. 
To produce these results the negative component of the energy variation given 
by Eq. (16) has been averaged over 10000 different spike trains of 25 ms length. 
Figure 6 shows the results at different values of the coupling strength k. 

Results for two identical neurons when the coupling is unidirectional are shown 
in Fig. 6(a). It becomes apparent that there is a region of values of the coupling 
parameter, around k = 0.6 where signalling occurs at minimum values of 
energy consumption by the receiving neuron. The energy consumption of the 
sending neuron remains constant because its dynamics is not affected by the 
unidirectional coupling. In Fig. 6(b) we can see what happens to the same 
identical neurons when the coupling is bidirectional. Due to the symmetry 
of the coupling the energy average consumption of the sending and receiving 
neurons are practically the same. It is remarkable the very neat reduction of 
energy consumption that takes place between values of the gain parameter k 
in the interval 0.2 < k < 0.25. Subsequent increases in the value of the gain 
maintain the consumption in a flat plateau at high values of energy consumed. 
At values of the gain parameter close to k — 0.5 the consumption of energy 
falls to its initial uncoupled level as complete synchronization takes place. 

For nonidentical neurons Fig. 6(c) displays the energy consumption of the 
receiving neuron when the coupling is unidirectional. The constant energy 
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Fig. 6. Average energy consumption through the membrane of the sending s and 
receiving r neurons at different values of the coupling strength k. (a) Identical neu- 
rons and unidirectional coupling, (b) Identical neurons and bidirectional coupling, 
both consumptions are equal. (c)Nonidentical neurons and unidirectional coupling. 
(d)Nonidentical neurons and bidirectional coupling. 

consumption of the sending neuron is not displayed for scale reasons. The 
energy consumption of the receiving neuron also exhibits a clear minimum that 
occurs for a value of the coupling strength around k = 0.6. Subsequent increase 
in he gain k leads to higher and higher levels of energy consumption. Finally, 
in Fig. 6(d) we can see the same two nonidentical neurons when the coupling 
is bidirectional. As it can be appreciated, the signaling of the sending neuron 
takes place at higher values of average energy consumption than the ones of 
the receiving neuron. This result is quantitatively consistent with the data of 
average consumption of energy at different values of the external current I 
that we have presented in Fig 4. Despite the unidirectional case, where the 
average consumption of energy of the sending neuron remains constant, in the 
bidirectional case the coupling also affects the sending neuron and makes it 
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Gain parameter k Gain parameter k 

Fig. 7. Mutual information to energy consumption ratio at different values of the 
coupling strength k. In the unidirectional coupling the computed energy consump- 
tion refers to the energy consumed through the membrane exclusively by the re- 
ceiving neuron. In the bidirectional cases the consumption of energy refers to the 
summation of the energy consumed through the membrane by each of the neu- 
rons (a) Identical neurons and unidirectional coupling, (b) Identical neurons and 
bidirectional coupling, (c) Nonidentical neurons and unidirectional coupling, (d) 
Nonidentical neurons and bidirectional coupling. 

modify its energy consumption as a function of the coupling strength k. The 
average energy consumption of both neurons follows quite an irregular pattern 
which can not be clearly appreciated due to the scale of the figure. 

4-2.3 Mutual information to average energy consumption ratio 

Figure 7 shows the ratio of mutual information to average energy consumption 
rate at different values of the coupling gain k, and Fig. 8 their correspond- 
ing averaged synchronization errors measured as the norm of the error vector 
e = ||x2 — Xi ||, for the same neurons and couplings presented before. In Fig. 
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7(a) the neurons are identical and the coupling unidirectional. As it can be 
appreciated, from k = 0.6 the information to consumption ratio reaches val- 
ues even higher than the one that corresponds to identical synchronization at 
k = 1.0. As it can be seen in Fig. 8, identical unidirectional coupling neurons 
at values of the coupling around k = 0.6 have still a high synchronization error 
and it is remarkable that transmitting information at values of the coupling 
where the channel remains noisy is energetically more efficient than trans- 
mitting with the noiseless channel that would correspond to complete syn- 
chronization at k = 1. Figure 7(b) shows the same identical neurons coupled 
bidirectionally. In this case both neurons respond to changes in the coupling 
k with changes in their energy consumption, see Fig. 6(b), and the ratio has 
been computed adding the consumptions of the sending and receiving neu- 
rons. As it can be appreciated, between k = 0.2 and k = 0.25 the information 
to consumption ratio has a neat peak with very high relative values. In this 
region of the coupling strength, the information to consumption ratio reaches 
values even higher than the one that corresponds to identical synchroniza- 
tion at k = 0.52. Noticeably enough, at those values of the coupling strength 
the synchronization error is maximum, Fig. 8. This is due to the fact that 
in that region of values of the coupling strength both neurons synchronize in 
anti-ph ase producing large syn chronization errors and maximum correlation 



values (ITorrealdea et al. 



20061 ) . Moreover, anti-phase synchronization occur 
at the least possible values of energy consumption, Fig. 6(b), what altogether 
produces the highest efficiency of the transmission from the point of view of 
its energy cost. 

Figure 7(c) shows the mutual information rate to average energy consumption 
ratio between two nonidentical coupled neurons with unidirectional coupling. 
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Fig. 8. Average synchronization error between two coupled neurons at different val- 
ues of the coupling gain k. The synchronization error has been measured as the norm 
of the error vector e = ||x2 — xi || and the average has been done, for each value of k, 
over 10000 trains of 25 ms length. The curves labelled UniEqual and BiEqual show 
results for the case of identical neurons with coupling respectively unidirectional 
and bidirectional and the curves labelled UniDifferent and BiDifferent show the 
respective results for nonidentical neurons. The external applied current is always 
I = 3.024 for the sending neuron and I = 3.024 or / = 0.85 for the receiving neuron 
in the identical and nonidentical cases respectively. 



As we have seen before, there is a region of values of the coupling strength, 
at about k = 0.8, where the consumption of energy is minimum, Fig. 6(c), 
and the mutual information has already reached its maximum possible value, 
Fig. 5(c). This fact is reflected in Fig. 7(c) where the maximum value of the 
mutual information to consumption ratio occurs at k — 0.8. Further increase 
in the coupling strength does not lead to any improvement in the information 
transmission rate but to a loss in the energy efficiency of the transmission. 
As it can be appreciated in Fig. 8, the synchronization error for this case at 
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k = 0.8 remains high but has no particular influence in the information to 
consumption ratio. Figure 7(d) presents the bidirectional nonidentical case. In 
this bidirectional case, the energy consumption corresponds to the total aver- 
age energy consumed by both neurons. The ratio of the mutual information to 
the total energy consumption of both neurons soon reaches a kind of uneven 
plateau with many peaks. All these peaks represent relative maxima of the 
information to energy ratio which provide plenty of room for energy efficient 
information transmission. 

4-2.4 Relative weight of the contribution from the synapse to the average 
income of energy through the membrane 

When a neuron is signalling in isolation the average energy dissipated through 
the membrane, energy consumption, is perfectly balanced by its average in- 
come of energy, that is the long term temporal average of Eq. (14) is zero. Nev- 
ertheless, when the neuron receives a synaptic junction its oscillatory regime 
is altered influenced by the synapse. The new oscillatory regime requires the 
synapse to play a role in the energy balance that makes the new regime pos- 
sible. 

Figure 9 (a) shows for two identical unidirectionally coupled neurons the av- 
erage energy derivative, that is the long term average of Eq. (14), of the 
postsynaptic neuron at different values of the coupling gain k. At k — 0, when 
the neuron is still uncoupled, the average energy derivative is zero, reflecting 
the fact that the neuron is signaling according to its natural isolated dynam- 
ics. In that conditions, the average energy received through the membrane is 
perfectly balanced by its average dissipation of energy. As soon as the coupling 
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Fig. 9. (a) For two identical coupled neurons net average energy rate of the receiving 
neuron at different values of the coupling gain k. The coupling is electrical and 
unidirectional, (b) Balance of energy in the receiving neuron. Curve Di, average of 
the negative part of its energy derivative, that is, the energy consumption rate of 
the neuron, energy that is dissipated through its membrane. Curve In average of 
the positive part of the energy derivative, that is, the total income of energy trough 
the membrane of the cell. Computation has been performed generating 10000 spike 
trains of 25 ms at each value of the coupling gain k 

is working the dynamics of the neuron changes and this balance is broken. As 
shown in Fig. 9(a) the average energy derivative at each value of k is positive 
indicating that there is a net and sustained increase in time of the energy of 
the neuron or, in other words, that the average income of energy is larger than 
the average energy dissipated trough the membrane. To make more visible the 
unbalance of the flow of energy through the membrane that takes place when a 
gap junction is present Fig. 9 (b) shows both the average energy rate dissipated 
trough the membrane by the postsynaptic neuron, that is its consumption of 
energy, and its average income of energy trough the membrane. As it can be 
appreciated, the average power dissipated through the membrane only equals 
the average power received trough it when both neurons are isolated at k = 
or when both neurons are completely synchronized at k > 1. When synchro- 
nization is not complete the average power supplied through the membrane is 
always larger than the average power dissipated through it. 
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However, the dynamics of the coupled neuron returns again and again to the 
same recurrent regions of the phase space, see Fig. 1, what means that its av- 
erage energy does not increase in time. This energetically sustained signalling 
regime is possible because the average increase of energy of the receiving neu- 
ron is compensated by a net outflow of energy through the synapse. Accord- 
ingly with Section 2.2 of this paper, our interpretation is that this energy is 
somehow transformed and contributed again as part of the total income of 
energy trough the membrane, i.e., the synapse must be energetically active 
during the synchronized behavior. Figure 10 shows for every studied case, at 
different values of the coupling strength k, the relative weight of the con- 
tribution of the synapse to the total energy income of the receiving neuron 
through its membrane. For identical unidirectional neurons, Fig. 10(a), the 
contribution from the synapse increases smoothly reaching its maximum con- 
tribution, forty percent of the total at k — 0.4, and then smoothly decreasing 
towards zero as the neurons completely synchronize. In the bidirectional case, 
Fig. 10(b), there is no substantial contribution from the synapse except in the 
region of values of the gain parameter 0.2 < k < 0.25 where the maximum 
information to energy ratio takes place. In this region the contribution from 
the synapse is as high as sixty percent of the total income rate of energy to 
the neuron through its membrane. For the nonidentical case, Figs. 10(c) and 
10(d), the contribution of the synapse reaches a plateau and becomes inde- 
pendent of the gain k. In both cases the synapse contributes nearly ninety 
percent of the total income of energy through the membrane. 

These results show that some production of energy at the synaptic site seems 
to be necessary for the neuron to keep its coordinated signalling regime. Nev- 
ertheless, there is biological evidence that links the generation of metabolic 
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Fig. 10. Relative weight of the contribution of the synapse to the total income of 
energy through the membrane of the receiving neuron at different values of the 
coupling strength k. (a) Identical neurons and unidirectional coupling, (b) Identi- 
cal neurons and bidirectional coupling, (c) Nonidentical neurons and unidirectional 
coupling, (d) Nonidentical neurons and bidirectional coupling, 
energy to the inflow of glucose through the membrane to produce ATP. Both 
facts could be reconcile assuming that the electrical energy produced at the 
synaptic site is conveniently transformed and reabsorbed by the neuron through 
its membrane for the generation of new spikes. Our proposed global flow of 
energy has been schematized in Fig. 11. 




5 Discussion and conclusions 



Since the work of Hodgkin and Huxley ( jHodgkin fc Huxleylll952l ). who where 
able to describe the membrane currents of the squid axon via a quantita- 
tive model in differential equations, models of that type are frequently usee 
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Hasegawa 



20051 ) to generate and analyze spike trains 



with temporal charac teristics similar to the ones em itted by real neurons. We 



have shown in Refs. (ITorrealdea et al 



2006 



20071 ). that this type of models 



can also tell us about the energy implications of producing spike trains. In 
this work we have assigned an energy function H(x) to a four dimensional 
Hindmarsh-Rose neuron. This function has the characteristics of a real phys- 
ical energy and, therefore, it can be used to estimate the energetic cost of 
any particular signalling regime, providing the basis for all the computations 
involving energy provision or consumption. We do not imply that this energy 
function is quantitatively and accurately describing the changes in energy 
associated to the dynamics of a real neuron. What we imply is that if a par- 
ticular kinetic model is considered able to describe some dynamical aspects 
of the signaling patterns of real neurons and we can associate to it a function 
that satisfies some required conditions, this function represents a physical en- 
ergy for the model able to describe the energy implications of its dynamics 
and, consequently, able to describe some energy implications of the signalling 
patterns of real neurons. Our approach is valid for many of the frequently 
used models of neurons in continuous differential equations. In principle the 
approach is not applicable to models of the type integrate and fire as they do 



not provide any structural 
energy function. In Ref. i 



hypothesis to supp ort the election of an appropriate 



Qzden et al. 



2004J) the synchronization between an 



electronic oscillatory circuit and a real neuron from the inferior olivary nucleus 
of the rat brain has been reported. To accommodate the oscillation between 
the circuit and the neuron an electronic coupling consisting of adjustable gain 
amplifiers is used. Experiments of this type seem to support that a flow of en- 
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Average energy dissipation = Consumption 



Average energy dissipation 




Average energy input 
from glucose 



Average energy contribution 
from synapse 



Average energy input 
from glucose 



Fig. 11. Average flow of energy through the membranes and at the synaptic sites in 
two electrically coupled neurons. 

ergy must be provided by the coupling mechanism and could be used to obtain 
information of the energy required for the synchronization of real neurons. 

A natural way to propagate information can be through a channel of electrical 
coupled neurons were signals are transferred from one neuron to another. For 
instance, electrical synapses between All amacrine cells and ON-cone bipo- 
lar cells are considered essentia l for the flow of visual sig nals in the retina 



under dark-adapted conditions (IKolb fc Flamiglietti 



1974 ). In the transmis- 



sion of informati on synchronization seems to play a key role. Veruky and 



Hartveit in Ref. ( IVeruki fc Hartveit 



20024) show that spike generation be- 



tween pairs of All amacrine cells can be synchronized precisely and that there 
is evidence that spikes can be transmitted through elec trical synapses be- 



tween these cells. Also in Ref. (IVeruki fc Hartveit 



2002 m they demonstrate 



temporally precise synchronization of subthreshold membrane potential fluc- 
tuations between amacrine cells and ON-cone bipolar cells. Identical neurons 
can always reach precise synchronization at sufficiently large values of the gain 
parameter. Thus, a channel of identical neurons at large enough values of the 
synaptic coupling constitutes a noiseless channel where mutual information 
reaches its maximum rate and maximum efficiency in the transmission could 
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be expected. Nevertheless, our results show that the information to consump- 
tion ratio reaches high values, even higher than the one that corresponds to 
identical synchronization, for values of the coupling strength below the ones 
producing identical synchronization. Transmitting at these conditions is ener- 
getically advantageous without implying a significant loss in the information 
rate. At these values of the coupling strength the synchronization error is 
still high and it is remarkable that transmitting information at values of the 
coupling where the channel remains noisy is energetically more efficient than 
transmitting with a noiseless channel. If the neurons are nonidentical synchro- 
nization is never complete and the channel is always noisy independently of 
the value of the coupling strength. Our results show that there is a region of 
values of the coupling strength where the mutual information is high and the 
consumption of energy is still relatively low. Further increase in the coupling 
strength does not lead to any improvement in the information transmission 
rate but to a loss in the energy efficiency of the transmission. 

The existence of regions of high mutual information rate with relatively low 
consumption of energy can be linked to the appearance of temporal antiphase 
synchronization. In these regions cross correlation of instantaneous values 
shows that the consump tion of energy of both neurons is basically incoherent 



Torrealdea et al. 



(120061 ) what could facilitate a cooperative behavior, espe- 



cially in a lar ge net of assembled neurons, and questions the point raised by 



( jLennie 



20031 ) relative to the severe limitations that the high cost of a sin- 
gle spike imposes on the number of neurons that can be substantially active 
concurrently. 

For the central nervous system it has been proposed the existence of a special- 
ized structural site, for glycolytic generation of ATP, localized at the postsy- 
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napt 



ic site ( jWu et al. 



1997 



Sickcvitz 



2004J). According to Ref. ( IKasischke k Weebb 



2004J) the temporal pattern of the presumed glycolytic response would directly 
follow the presynaptic input in order to meet metabolic needs induced by the 
processing of nerve signal transduction. We have found that the synapse must 
be energetically active during the synchronized behavior. On average, there is 
no flow of energy through the synapse from one neuron to the other but a flow 
of energy leaving the neuron at the synaptic site. It can certainly be instanta- 
neous flows of energy from one neuron to the other, in fact, it is believed that 
the el ectrical coupling itself is caused by flow of current through gap junc- 



tions ( jVeruki k, Hartveit 



2002 a ). but the net average flow of energy between 
the two neurons is zero. The average income of energy through the membrane 
exactly matches the average output of energy through the membrane, energy 
consumption, plus the average energy leaving the neuron at the synaptic site. 
We hypothesize that the energy leaving the neuron at the synaptic site to the 
extracellular medium does not substantially degrade and it is somehow fed 
back again into the neuron through its membrane, Fig. 11. The Hindmarsh- 
Rose model of the dynamics of the neuron does not provide enough biological 
information as to be able to decide which terms in the energy derivative should 
be considered energetically conservatives. We have assumed that the net en- 
ergy contributed from the synapse does not imply a net energy consumption 
and that it is in some way recovered an indefinitely reused for the generation 
of new spikes. It could be well the case that part of the synapse energy also 
degraded. In that case, the consumption of energy of the neuron to maintain 
its signalling activity would have to include the dissipation of energy in the 



synapse. 



Energy efficient information transmission from the point of view that inputs 



41 



are optimall y encoded into Boltzmann d istributed output signals has been 



analyzed in ( iBalasubramanian et al 



200ll ). An open question is the determi- 



nation of the energy cost of generating the spike trains that codify each of 
the different output symbols. Our approach provides a way to determine the 
energy cost of the generation of different spike trains. It is to be emphasized 
that the distribution of energy cost of a set of symbols can be very dependent 
on the particular coupling conditions of the signalling neuron. 



When the availability of energy is a significant constraint a trade-off between 
the transfer rate of information between neurons and its energetic cost is to 
be expected in order to obtain an efficient use of energy by the neurons. Our 
results, obtained from a comprehensive single model of neuron that links in- 
formation and energy, provide room for such a kind of trade off and suppose 
a novel approach to the open problem of whether biological computation op- 
timizes the use of energy in the generation and transmission of neural codes. 
It seems likely that real neurons use energ y efficient circuits to generate and 



20051 ) that the neu- 



transmit information. It has been reported (jVincent et al. 
ral organization observed in the early visual system is compatible with an 
efficient use of metabolic energy. The center surround organization of retinal 
ganglion cells optimizes the use of energy when encoding natural images. Other 
aspects of the organization such as the higher densities of receptive fields in the 



fovea that decrease in the p eriphery coulc 



the use of metabolic energy (jVincent et al 



also be in an attempt to optimize 



20051 ) . In order to test their energy 



efficient coding hypothesis Vincent et al. use a model where the metabolic cost 
of the synaptic activity and firing rates can be fully manipulated. In the reti- 
nal stage, a cost that increases in proportion to synaptic activity is imposed 
while in the cortical stage they suppose a cost proportional to the firing rate 
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of neurons. Although this is certainly a plausible hypothesis it is not based on 
any comprehensive model of energy linked to the true dynamics of the firing 
regime of the neurons. We think that models of energy like the one described 
in this paper could provide support to empirical studies to ascertain if neurons 
really are taking advantage of efficiency savings. 
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